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ABSTBACT 

Different structural, organizational, and nanagerial 
options greatly influence the role of evaluation. Evaluation serves 
different functions in organizations of higher and lower autonoiy and 
likewise in progressive and reactive organizations. The role of the 
evaluator in the organizational hierarchy was dictated by the type of 
organization. In high autonony, progressive organizations the 
evaluator was far renoved from those on the production level. In low 
autonony, reactionary organizations, the evaluators at tines were the 
sane individuals as those on the production level. Such 
organizational and nanagerial options had considerable influence on 
the resultant role and inpact of evaluation in a given development 
effort. (Author/SM) 
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J!nt^od.uotl£n 

Even before discussing a topic such as "lufluenoG of AXternative 
StructAiml, Organisational and Managerial Options on the Role of 
JSvaluation," one has made several tacit assumptions. The more important 
of auoh assumptions are these three: 

1. The role of evaluation is in fact dependent on alternative 
stnictural, organizational and managerial options. In other 
vords, the nature of evaluation in an educational research and 
development (R&D) agency will differ from agency to agency** 
and overtime, within any given agency— as a consequence of the 
manner in which the agency is managed and organized. 

2. Some roles of evaluation are more appropriate than others 
depending on the types of agencies in which evaluation perfoms 
tt role. Were they not, it would aako little sense to discuss 
the managerial options which influence the role of evaluation* 

3. Because inappropriate roles for evaluation in an educational 
R&D agency can be inefficient at the least and, at most^ 
dysfunctional, it is worthwhile to constructively worry about 
the appropriate role of evaluation « 

These assumptions serve as both background to this discussion and 
as the quasi-logical premises on which it is based. In brief recap: 
it is asnuinod/arguod that the role of evaluation will vary as a conscquonce 
of such fchingn as the manaccmont options of the R & D agency in which 
it oporcitccj that it will vary in conic i;ays which arc more appro- 
priate than others J and that because inappropriate evaluation roles 
are (tit aoant) J.noiTicient, it :iy worthv/hil.o to oxamlno some of the thlncn 
which inQuonce the role of evaluation. 
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pofinl^-.inna 

A title as loriK imd cur.ibcraomc as that given to this paper dorjUirKla 
that some definitions be «et forth and that the rclationshipa among the 
defined concepts "be given some kind of order ♦ The conoeptw most in 
, need of definition are these: Manar^oinont, Orf;an :lr.a tion, Str ucture » 
and KvaluatiQiu Both the followins definitions, rmd later, the logic 
coiir ructed to give order to them, have been developed arbitrarily-^yet 
hopefully, consistently— in order to adapt them to the context of this 
discussion (e.g., educational settinfjs, R&D agencies, evaluation 
roles, etc.). 

Managemen t; As a function of an R & D agency,* management refers 
to the set of actors and activities which establish and maintain 
the overall purpose and stratef;y for the agency. 

Oraanigation ; The means or process by vhich an agency chooses to 
arrangje itself to achieve its purposes . The most apparent evidence 
of an agency's organization is its structure . 

Structure ; Structure is the formal pattern of authority and 
responsibility assigned to the roles within an agency as well as 
yelQ,tionahi|)s among those roles. An agency's structure is most 
often and clearly depicted in its "orf.:ani'zational" chart. 



* Throur.hoat the papor, "ngcnoy" rofcra to im ndur-'ttlonnl R ^; D 
li.C£:»?IL^i-"'"^'^^i-i'<3h itself is probably bc.';t; ai;i'ln'?d tv, auy'^iT^'-Ip'ol' iiiXiviauals 
vlilch Invc orfmlKed itot;ir in a r.'>.nnor l('r,M.1..1y rntJtHii.': it to rccoive 
and expend monies for the stated purpose ofdoiini^ eduoutiona.l R ii Dt 
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i'lY.^AVlOjj*^:Pil' J'^raJuation is defined hore as %h('\ e proGenaen vhich 
pomit an aKoncy to dot ermine tho extent to vhiob any of :itr. 
pv\rpor.cr; arc boinn (or have been) achieved ♦ 

U clabi orK;h:i]') AirjOp'!: Cone cut n 

Given tlier^a definitions, it is liiiportant to dcncribe the relation* 
ships njiionji; the defined concepts. The ningle most important doterminaiit 
of the overall or j'Ani nation, stmcture and role of evaluation v/ithih 
an agency are the inanagemGnt "options" "v/hich determine: (l) its cqib*' 
pitr aent to^ eduGat ional ehan,qo and (2) the degree of auton on ^^ vdth whidh 
it is able to seek its purposes. 

"Options" is actually a misnomer because of the incorrect implica* 
tion that the purposes and strategies vhich result from an agency •s 
managejiicnt process are made by the design of the "managers." The point 
is that vrhether by design or default, the l^mction of management results 
in decisions v/hich determine the agency's commitment to educational 
change and to its autonomy. 

Thus, vrhile it is recognized that a host of ill-defined and shifting 
choices and circumstances act as influences on these management decisions^ 
it is the purpose of this discussion to exi)lore their organizational, 
structural and evaluative conM cqucncMs , not their nmy and varied 
antecedents. The proiuise on v/hlc}) the rpiiriindcr of the paper is based 
is that the? agency *n Goi^ltn-rnit e au't^ii j.(?ivi]. ch^ iir;^j; and relative 

represent the morjt in.portant of ail porjsibTc managament choicort 
of purpone and strritecy. The chuin of lotM.urnoo cati be depicted art on 
the followln^;* par',0. 



m m AVAIUBLE 







lJecisionj3 - 


IT vnuur ' 






and Mxioxion^ 





1^ 







STHUCTURK 
of the 

RAD Agency 


OL' thC! 

R 5; 1) Agency 


^ 




1.^ ROLE OF EVALUATION 



Staffing 
ReqriremGnts 



Criteria 



"Distance" 

from 
Production 



Suramative- 




Other 


PormtivG 




Consequences 


Krrtphasis 











The rationale for scloctinc "coiniaitmont" and "autonomy" as the two 
conditionrj most predictive of v/hat and hovr an R ft D accncy is and 
is .Ukely to bo doilnc in cirnpjy that thoao tv/o condibions, more than 
any oth u-i;, mirror uuch things about thi: ar.'-ncy ar. ita philouopViy, 
loadcrr-hip, ctaiTin^, l\indinfi pattcrna, conr.tituonaiotj, aponaoro, 
Maturity and hir.tory. 
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AYU^n o.:, - /' nTi '.l C ouV/.l t" . j ut _ C .1 ari o J . i\lo u and Conti < . :cmu-nc c; ; 

/Uit.ojionv^^ .is doi'ined as the degree to v,'hich an K & D agency has 
the ability to determine ito ovm future. Coiiimitmen t to Kdncation Ghan^g^ 
in derincd ar. the extent to v/hich the R D agoney in willing to alter 
the statujj quo in order to bring about what it defines ac educational 
improveit-ents. Thus, with the understanding that myrial conditions 
are antecedent to an agency's "choices" on AutonoiTiy and Coiundtment 
dimensions, aiid with the i^irther understanding that each is complex 
and continuous in quantity and quality, the classification presented 
below (tsee Figure 1) represents an arbitrarily simplified model of 
these tv.'O dimensions. 



A Classification of Educational R&D Agencies 
According to CoTtrndtment to Educational Change 
and Degree of Autononjar 
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This c.la5]P..1.f1 cation vil.1 .servo ars tho banis for portrayinn each of the 
four "typos" of R ^4 I) nKoncles. Each tj/i)G will he dorjcrihcd in terms of 
po^Jiiiblo orf,anir.ational aiid structural charaotarlHticc, and— jno«t 
importantly here— jji terms? of tho different rolea evaluation would play 
in each type of agency, A final caution before continuing an examina- 
tion of these eonscquoncasj it is evident that: 

R&D agencies cannot bo categorissed neatly into these four 

types. 

The "high-low" dichotomies are conveniences, not realities. 
The relationship between "autonomy" and "commitment" may 
well be interactive. 

Even if classifiable into one of these four types, an R & D 
agency would very likely change over time from one to the other.* 
Ca.veats aside, we can turn now to an examination of possible 
consequences on an agency's organization, structure and evalviation 
roles. Figure 2 provides an overview of the principal consequences 
of each type of agency. 



* A study of tho "life cycle" of an R & D agency across these 
four ideal types would bo interesting. One mif^ht hypothesize that 
tho cycle would move from "l" consecutively to as a consequent of 
incroaning confidence and "success" at each typo. Incidents of the 
"bubble bursting" resulting in a inovcraont I'rom "H" to "l" might 
also be found. 
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The Omitilonn nnv.opyo h^'nnnyt noJo typo of R & D ncency mr.t oporate 
on a low rick, high volume and (thcrGforo) low loverago bursio. Risk is 
the pro'ba'bilj.ty of fail\ire, and fai3-Ui'e for the cautious reactive agonoy 
is represented by a drop 3ji "sales/' Tlius "customer satisfaction" 
becomes the principal success criterion and because the educational 
needs emanate from status quo activities, the likelihood of high 
leverage products is very low. (High leverage products are those 
interventions which are likely to result in a high leve3. of positive 
change through ripple effects via intemediate audiences or generaliz- 
ability.) The paradigm for this agency is a marketing-sales model, 
A comprehensive paradigm of social change and programmatic R&D would 
liot meet its purposes because those purposes center on meeting the daily 
needs as expressed by clients regardless of the logic, validity or 
change potential inherent in the symptoms described by the client. 
This agency is likely to be motivated by profit and/or size as it wcitild 
be expressed in numbers of staff, volume of sales, and so forth. Its 
core functions, and in the general sequence as stated, would be those 
of advertising, selling, manufacturing and delivery. Its business 
office and sales force would represent its largest organizational units. 
Quite likely, the sales-manufacturing functions could be performed by 
the some individuals. Overall, the Cautious Reactive agency will develop 
and soil whatever products have been o:-:prcnccd to them as needs by 
clients. It must operate on high voJ.umo tind fast turnaround. There is 
littlo tljnci or inclination for any evaluation other than that ncccncary 
to appcaac cponr.ors and clicnics. 
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SiunimtivQ evaluation in llmitcid larnoly to fiscfil data and to data 
rof. looting* r.aloH voluno, The products from tho Cautiours I^cr.otivo 
accnoy vrill "bo litiiitod inor.tly to lai'cc nmbors of inatorittlc for loamers 
or.- teachers. Bccauao there is .little dosirc to follow-up or in anyway 
detomino the utility of tho«e mtorlals, the need for formativu evalua- 
tion is limited to colcctive historical aceoimts of tho developuiont 
procorj.j v;hich vill embellish the packagins of the products. Formativs 
laanaKoinent informtlon needs are met hy providing data about costs and 

SChodulfJ.'S. 

Tho staffing rcquireinentf. for evaluation ai*e minimal. It may well 
be that no staff moiribors perform an identifiable role of evaluation. 
The evaluation functions center on the required fiscal, packaging and 
scheduling data. 

ThG concept of "distance" is important to each type of agency. 
Distance! refers to the extent to which an evaluation function should 
bo structurally separate from the agencies production function. The 
rationale for distance considerations center on the problems of co- 
optation, role conflict and lack of credibility. Distance is maintained 
by providing a structure vMch assigns different levels of authority 
^''^^ VA^y ^o^-^-'^'^^^}-'^^y "i'O the evaluation fxinction vis a vis the production 
Amotion. The abbreviated model depicted in Figure 3 represents 
e::.?jnploc of different levels of distance. 
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With each hlnh^r Icvol of (]:lr,t.incc, thu anoitnt oi* i-i.<.';]-.onr.i!hn.ity 
and aut^ioriiy alloaated to iho evaluation wit Inori-'ar.c at: i^robiems oi' 
co-optation, rolo conflict and lack o* credibility Uecroanu. The need 
for di.'.:tanco ia a conucoiuoncQ of jiuch conditlono an: 

H-'oduct objectives which luirpoi^t to demonstrably alter 

(inrprovo) a civen state of affairs in some educational setting. 

^(^Gncies vdth large teams of product developers v/orkini^ on 

multi-year efforts. 

Managerial choices which require that products be tested and 
proven prior to dissemination. 

Sponsor/client demands that products moot measurable specifica- 
tions. 

Agency commitments to widespread educational improvements. 
Thus, for the Cautious Reactive agency, there is little need for 
distance between the functions of evaluation and development. The 
evoluatovs (if they exist) could easily be assimilated into the 
production/sales teasns in this type of acency. 

The Agr^Ycsnive Keactive R Hi 1) Af^oncy ; This type of acency differs 
from the Cautious P.oactivo accnoy primarily in the confidence it has 
in being able to market its products. It may well have mratured into 
its current mode from its fomor stylo as a Catitious Reactive agency. 
Some hierarchy is ncicossary for its organi::titional structure and the 
jjiterface bGtv;ccn its "sales force" and production units is important. 
Its rinlts are slight.ly h.1ghor tlnn the Cautious Ueactivo afjcney because 
it stoc)ii>llcs products which must then bo so.ld. Overall, however, both 
titik aiv\ lcvc)ra,':c} ai*e 3ow. No paradigm of (!duoat;lonnl/,'.;ocial. change? 
g'^^verns t)iio {igi..'noy« Mor(j attention glv-ii to iirvd:! !i.,"..".t<:-.(i;.)ont than 
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mujLVt OvduO Ujat Lho i')rouuot will bo jjalublu onco duvelo]H;d, i-'or this 
scwic rutiGon, coiriO ciccrco of rollov/«up evaluation iiiuy occur for tlio 
pv^rpor.!03 of roconf Inning prior hunchoa abouc JiuirKotability, or to a 
loaccr extent, to mko rovlfiions on cxiatinc producto. In neither 
of the reactive a{;;enciQ!3 are Kucceas criteria derived from demonstrable 
chan(;.ofl in some a priori apecified audionco. T}ius, the ncjod for tho 
weasuii'ttwent apeoialist evaluator is virtually non-existant. 

^Jaintainins ^ "cUstanca" of evaluation from production is not 
particularly important. The poissible exception is in the area of needs 
asses f;rient. Here a needs assessment specialist or piarket analyst may 
be employed to provide chocks and balances for over tsealous product 
staff. Among the more iraportant manaGcmont decisions to be served 
by evaluation in this agency is tho need to knoi^ the potential markets 
for given products. Aside from marketing/needs data, it makes little 
difference if the evaluator s are co-opted in the Aggressive Reactive 
agency. In fact, the overall efficiency of tho agency is probably 
increased if the evaluators bocome co-opted. Credibility is no issue 
to management and v/ill appear as an iccuo only if sponsors or clients 
exert pressure to see tested products. The evaluator in this o-gency 
^*ould either vork for or be indistinguiohablo from tho product dovelOpefS* 

yhf^, J>-^.tio'j:i Proaetivo H tt Afy-.'ney ; Thifi agency differs from both Of 
tho provioufj tv;o in its coiiimitrncnt to oliango. It is not satisfied vrlth 
appear OMi'int of tho status quo as a cuccoss criterion yet it must 
pi-'-'C'-Je .'^uaiMixlly in its change strategy. The mont likely reason for 
iir. cinitlon v/.ill bo tho e}r})eetntions of sponfior.".— particularly if they 
rrj'?'.-.- -Ill, r.vi')'/i.l. do.ll.ari3 \/liii;h JuU.'.L be Ju;)tj i'iecl (ifid al.loeated {innually* 
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Tho polu.t.!.ca I. atmor.phcro of the Cautious Proactive anonay in CAxah that 
it conrnuncfi r.uuh o:C tho time anrl onorf^iofi avallablo to tho ti^^noy, 
The real (la:)f,or in th.l:j type of a,:;oncy— v.'hich, incident.' iv, probably 
l)Ost chaructcrii'.cd "by many of the national Univoraity R & D contor;] and 
Regional Developmont la.bo.ratorlo!>«aro that whllo aspiring lio tho status 
of tho Afijijrcflaive Froactivc agency, there arc nsany praricuroo to move 
to tho Reactive stance . The procauroi:; Inoludo annual Aindin^; Jociyions, 
political priorities, sponaor inatabiliticc, and unrealistic auGcoi;s 
expectations « 

The Cautious Proactive agency is the most vulnerable of tho four 
types because of the inherent discrepancy between its puri)oses (cowflit* 
aient to chancio) and its strategy (low autonomy/caution). It must 
continually attempt to attract and appease sponsors without sacrificing 
its pui'poson. This aconcy operates under a chance and development 
paradigm. It has a set of logically and empirically related principles 
vAiich represent that poi'tion of tho educational system it intends to 
change. Without such a paradigm, any commitment to educational change 
is hollow or naive. 

This agency is likely to have more full time profonsional cmployeoa 
than either of the Reactive agoncios. Its organ iaational structuro is 
more pyramidal because of the increaricd nood for special iaation of staff 
and thcrcforcj a need for a ooordin-atod (ilvxnion of Labor. Its typical 
product is one vhich has bean .'i rolatlv-'ly .Ion.-, tine in developmont. 
j'loct j.;n:"'ort'\ntly, in dL'-.timiuichJir-; it from the H';.'ictivc agcrujy, the 
criteria for product success inolxido the in i'd to (K!;aonGtro.te cliniigos ih 
tho knov/ledgof) or skills of spec if led groups. 
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TM r fn^v'.''v;p. ':'.'rH'"T Ion rc-.'^ui that tho ovLlAi'itlon r'.t",fr It^vc? 
{.•.Kill!.; in p.-yjho....,-tri's.' u'lUvcM.nvk} jv.arh'fjt analynla nacl tccluvlquoH 
o* rorj.vAtive -jvalviutioiu The attc<iit;lon ^ivun to Guiivaatlvu ovuluntion 
in conprclionrj.ivo and f^roat caro in taken to annure that t.lio ar.oticy can 
acooimt for all ina.;.or aotivitioc. Auditahlo ficcal and pcrfonfiance 
record?] are imrjoic'tant hecause of wpotisor e:cpGOtatlona, Again, ■because 
of siionaor uncc-rbaintios and anxieties, the 1'oiin.ative-iJWiiiaative balancG 
my tip ooca-rionally toward the accountability or suiuroativci eide at 
the expense of necids for formative evaluation. 

Because this agency has litulc autonomy, the notion of its commit** 
ments to educational chanse is likely to be modest as operationaliaed by 
the instruments desicned to measure chanse. The products are likely 
to be "internally valid" but are not likely to have undercone thorough 
evaluations which looked at comparative merit or unintended consequences* 
Lots of attention is t^iven to criterion referenced testing. But because 
of the less sophisticated change/development paradigm of this agency iiii 
GomiJarison to the Aggressive Proactive agency and because of the 
an:<ieties of sponsors, test data will abound in the evaluation 
reports developed for both internal and external audiences. 

"Distance" is important in this type of agency. Because the 
product devo]oport3 nuiit cinpirically demonstrate tho v/orth of their 
efforts, th'j rciiponnibility n-nd author.! ty for evaluation muat be as 
ind'jp^ndcnt as po;jr;j.blo from th'.i prod\iction function. The continuous 
:tviteri" H;^' tli:it is nooo:,.';.ary b' tv/o.jn („ valuator and ileveloper incroascrj 
thj dan;/.-r of co-ojjtution. lU;cau:.;i.: of this, it is essential tljat tho 
{.v;il\5:itor b- r.l ni'-auril'ly iji.U.iv'ndfrt and tb.'vt ho/v.hc bo dty^o;;';'! and not 
ri'-.;;l''n--.i to fio-H^ii'lo M 1) orj'ort.".. P-.-cautJo th'j af/Micy has ]ow autonoi.iy, 
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tho oi*..'-i U.:n ■ r.: ^ • :'t.icnV.r"':.' Irpovt'mt to .'-"•iri.'-o;-:: , l;'-..'i<V"r', 

tlio i\otit ;'u..porb:i.ut i-cy.iJon X'or ov.'i.'l.\K.U..loa'.<.-. rolufc.ivt« .In i,/!)..-!!.'.- n.; : Vv^y.a 
production Ifi the ir.ana'>'inont C!o;i*.rr.i.t]:icnt to ch:^n.<3c!, 

Tho Ar.,'.f'^";;lv.: rro;<.r;tlv\.'. R f' D Ar'otKv/: For X'c:i.';ona which obviously aro 
a combination oC fortitude unci fo-rt\:no, thi« Mc;cncy enjoy;] thu lu,'.lto.';t 
levo.1. of autonoiiii'' while utill mlatalnina w i.vinu(.ici:ic;nt oo:..;r*].t!r;cnt 
to eduf:tvtiono.l chance. It is likely tliat it h> thu inont wiiturc of tho 
Horn- typoc. and that it has a high quality of lecdoi-ahip and ataff. 
Its orGani;:ational stmcturc is veil established and cloaely parallels 
the paradicm it has evolved for educational K P.i D. It ic 3ikcly to be 
structured according to functions such as "feasibility analysis," 
"prototype development," field "tcstinc," "dissemination," "evaluation" 
and so forth. It probably has but a fcv; grants or oontracts, each being 
relatively larco. Grants, foundation support or successful "cost- 
recovery" ef j?orts (obtained perhaps from earlier days as a Cautious 
Reactive acency) have contributed to its autonoiiiy. 

This afjcncy is the most selective about the wor]; it v/ill undertake. 
Potential efforts v/il3. be carel\illy screened to deturnunu concirucnee 
vith acency mission and capacity. Very likely, it has stnif'.clod through 
ynars of "hack" contracts in order to achieve the status that it currently 
enjoys and protects. This agency represents the highest leverar.o 
potential; in lai',"/; pai*t, it does so bccaune of th'j conl'idenco is 
lias in its parnxlicm for chan^o and development. Jt will address wich 
of its efforts to interwcdiato- level aotors in thr. cdu'.'ational syri.'/Mi:; 
(o.e., udmiiixstr/itors, counsolors, ;;tatc or f'.M.;rM.l 3.r.'i,d.-r;;hii), cownunity 
croups, eto.). V.Mt unlike thu Cnutlous I'roai'.t.) vo uf.-.'uoy, its uueeoss 
criteria do not end vith luiV.ii-j M..j.v^iii:.l.rnl,.- 1 UinL li.-'.;-. l"M<n 
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mixda on t)io.".o .iniorm^!'l:i'j.to fuuUcincoa with only tlr? '.lofvjc htkI hop(» tliat 
oth''«r pori.tivo oonroqti-^n'.^'^f? \r\ll rtoo:/nte, Hathor, itr, fiy ^toii^jo approach 
to c;h".u,';o niid (\uo'j.t Tor .'maconr. fin UoT'wOr:: rfjqivl.ro vbat t)u; Tj.rO-.'iri'.'U 
from ilnter.'nt^diato to ultinato uudiloaaea (mor.t often cliu*.r,roo!n looj-nura) 
b(} (lewonstratud o2nxj:l.riG0.11y, In a,dd:ltion to a roqulri.'rn'.)nL tliut tho 
link.M.'T.ey roiJiO.tins .Crom levera^G ntratccios "be clo!nonf:ti-at'..''l, it io 
Xiholy to r.ocV. cvldonGO of coinparative worth. In itti follow-up cvaXua- 
l^-'-O"^* ilili concociuencos (both iutGiidcd and unintended) will bo £;ou.'/,ht. 

Theno r.xxccess criteria require a highly diverse and nophir.ticated 
evaluation ataff . An appreciation and undoratandinj^ of cyntaiiic change 
requires behavioral scientists and General Dyr.toms 'nieorintsj the need 
for relevant fomative evaluation data by v;hioh products are revised 
and improved must be rnetj and it nrast have the psychometric and design 
skills to demonstrate a product *s validity for both intermediate and 
ultimate audiences. 

Most evaluation effort is directed to forriiative data. The summative 
evaluation stratesj'- is one of maintaininc a coniplcte and auditable log 
of all important decision points during the development process. This 
audit trail serves the purpose of being accountable to sponsors and 
consumers at the saine time that it provides historical information to 
product developers v/Tiich allows them to avoid pact miatakes and learn 
Cro-A nucjGorjfJoy, 

Dnr-tanee mxr.t be maintained betvrucn cV!!.luation iHmotionti ;uid product 
dc.-V('1o!T:,iont functions. The niiilti-ycar dcvcToj:::;'^nb cProvt:: require that 
dirfor -nt ov.'i.luation f;p.'Ciali«t» interact with devt?lopcrr5 over tlio 
wnduot's life cycle \;hile still maintaining their struot.ural indopendcnco 
l.ut a.'Vi.ln, the moLvb itiij)ortaut rr.iv.-.on for diiitruKJe is the /".-vncy's net'd 
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'^'^ H-'-nt to f; "iv"'.'- ••fv«-\ (!].•• ri It cannot ccnvlt ity.olf to n 

j.ii.";to.v.; oi:* c}i^'.itv' v/itlioul iX t;orr'j.;iJU)iOiri£; cOi:::ait.iiC'at to an « valuation 
Unotion •,;!'. Ich poraibc it to detorwinc tbo extent to vlilch its puri)0i5cs 
arc boln,'"; int. 

In brief.' yujiiruuv, it haa 'been the pm^porjc of thia pax^or to examine 
;;o:iu' Oi' the connGquGncco that difxcrent managerial options have on the 
role of evaluation in tm educational R&D agency. Although the 
"evidenao" for the h\mches and propositions expressed here io cxjic- 
riontial and intuitive, it is hoped that this discussion will contrihute 
to what should be a continuing dialogue and study of the role of evalua* 
tlon. Both education R&D and evaluation now enjoy (and suffer) frQm 
'inothorhood" and "'.nie 3iJmperor*s New Clothes" syndromes. And they 
vdll improve only if we ask if and how they are really needed and then 
look very closely and carefully at what they are up to. 



